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HYBRID DATA TRANSPORT SCHEME OVER OPTICAL NETWORKS 

Field of the Invention 

The present invention relates to a method and/or architecture for hybrid data transportation 
generally and, more particularly, to srading a mix of different data types over a fiber optic network running 
SO>rET/SDH framing. 

Background of the Invention 

Lx)ng distance and metropolitan area "n^ty/ork (]ViA2^ coxxuxxviiicsLtioTis rely on short-haul and 
long haul fiber optic networks to transport data and telephony traffic. One conventional way to transmit 
data in fiber networks is through a Synchronous Optical Netwodc/Synchionous Digital Hierarchy 
(SONBT/SDH) protocol In a SONET/SDH network, data travels in fixed size envelopes that repeat every 
125 microseconds. With this synchronous fixed-length framing, every byte (e.g., 8 bits of data) inside a 
SONET/SDH frame represents a 64 Kbps (64000 bits/sec) channel. The 64 Kbps chaimel has the same rate 
as supported by current telephone channels (also called DSO channels). 

SONET was designed to efficiently carry telephony Plesiochronous Digital Hierarchy (PDH) 
channels such as Tl/TS. This was easily achieved by dividing the payload area in fixed slots called virtual 
tributaries (VT). These virtual tributaries are then grouped together to form higher-rate channels. These 
fixed slots arc cflScient for carrying fixed-bandwidth telephony chaimels because any one or more channels 
can be added or removed from a bimdle without processing an entire payload of channels. Because SONET 
frames repeat at fixed intervals, these virtual tributaries have fixed locations and time intervals, and it is easy 
to extract T1/T3 or fractions of Tl without processing the entire SONET payload. 

With growing volume in data traffic, however, SONET/SDH networks must now cany a 
significantly large number of data packets - such as ATM (Asynchronous Transfer Mode - 53 bytes each) 
and IP (Intemet Protocol - variable-size packets) in addition to traditional T1/T3 channels. The synchronous 
framing structure of SONET/SDH that is quite efficient for carrying T1/T3 channels is not able to cany both 
fixed-bandwidth and variable-bandwidth channels in an optimum way. 

SONET/SDH has an inefficient utilization of fiber bandwidth for data packets. For data 
transport, some of the virtual tributaries are created for transporting fixed-bandwidlh T 1 traffic while others 
are used for transporting packet data packets such as ATM and IP. Since an individual virtual tributary has 
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a limited bandwidth, extra mechanisms have to be used for sending data packets of higher bandwidth using 
virtual tributaries. 

In one technique, a iOMbps data packet channel, for example, is inverse-muIt^)lexed into 
smaller bandwidth streams and then sent on many virtual tributaries. At the other end, these streams are 
5 integrated to reconstruct the full IOMbps channel In another method, many of the virtual tributaries are 
concatenated using hardware to create a higher-bandwidth virtual tributary for tran smi t t i n g the high- 
bandwidth data packet. 

SONET/SDH lacks of support for data mixing. A SONET fiber link carrying frames 
containing ATM cells cannot carry POS, because ATM cells firequently carry QoS-sensitive data such as 
10 CES (Circuit Emulation Service) or multimedia traffic. Introduction of SONET fimnes containing POS will 
cause significant delays (e.g., 125 \iS for each POS frame inserted in the link). 

In each of these methods, a unique Path. Signal Label (PSL) value in the POH (Path 
Over-Head) field of the SONET firame identifies the type of data transmission inside the payload. The 
payload area is also referred to as SPE (Synchronous Payload Envelope). Because a PSL value identifies 
1 5 contents of the entire SONET payload envelope, only one type of transmission can be supported at a time 
in a SONET frame. 

One method for data transmission is to use the entire SONET SPE for data packets. The 
SONET payload area is filled with IP packets using Packet-over-SONET (POS) packets. POS packets are 
packets deliminated by 0x7E (Hexadecimal) at both ends of a packet, with a firaming using PPP (Point-to- 

20 Point Protocol). Many packets can be put inside a single SONET SPE. This method can only support 
variable-lengthpacket protocol such as IP. A SONET fiber containmg these packets caimot transport T1/T3 
channels or real-time streams using ATM cells. The reason for this limitation is that each SOl^T SPE 
containing IP packets, for example, introduces a delay of 125 microseconds. Such a delay is not acceptable 
for T1/T3 circuits or real-time streams using ATM cells. 

25 Anothermethod for data transmission is to use the entire SONET SPE for ATM cells. In this 

case, a SONET SPE is filled with ATM Cells. ATM cells are delimited by their fixed length, and are 
tracked by doing a hunt for their header checksum byte. Services such as Tl, Frame Relay, Ethernet, etc. 
are transported over ATM using standard protocols. This requires complex implementations in hardware 
and incorporation of ATM service interworidng at each service boimdary. 

30 Another method for data transmission is to use the virtual tributaries (VT) for data packets 

and ATM cells. In this method, a SONET SPE is partitioned m many fixed-bandwidth slots called virtual 
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tributaries (VT). For data transport, some of these virtual tributaries may contain TIATS type of fixed- 
bandwidth traffic while others are used for transporting packet data packets such as ATM and IP. 

Since an individual virtual tributary has a limited bandwidth^ extra mechanisms have to be 
used for sending data packets ofhighorbandwidth using virtual tributaries. In one technique, a 10Mbps data 
5 padcet channel, for example, is inverse-multiplexed into smaller bandwidtH streams and then sent on many 
virtual tributaries. At the other end, these streams are integrated to reconstruct the full 10Mbps diannel. 
In another method, many of the virtual tributaries are concatenated using hardware to create a higher- 
bandwidth virtual tributary for transmitting the high-bandwidth data packet. 

Each of these methods uses a fixed-bandwidth channel or a set of channels for transmitting 
10 network data packets. In each method, bandwidth capacity of the fiber is poorly utilized since network data 
packets are bursty in nature and average bandwidth utilization is quite low. 

Referring to FIG. 1, examples of various data types are shown. A set of time-division- 
multiplexed (TDM) packets 12a-12n, aset of ATM packets 14a-14n and aset ofPOS packets 16arl6n are 
shown in connection with a SONET fiber line 18. In a SONET network, only one type of data can be 
15 transferred at a time. The data is identified by a unique PSL O^ath signal label) byte value inside a Path 
Over-Head (POH) of tile TDM packets 12a-l2n, the ATM packets 14a-14n, the POS packets 16a-16n, of 
PDH traffic. The nodes at difiTerent points in the SONET fiber line 1 8 have different types of data to send 
on the network. 

Rcfcning to FIG. 2, an example of a system 20 illustrating problems in transmitting higher 
20 bandwidth data packets withfixedbandwidthslots is shown. Transmission of fixed and variable-bandwidth 
packets in SONET/SDH frames is shown. SONET/SDH was developed for eflSciently transporting 
telephony signals over long links. In order to support timing of the smallest telephony components DSO 
(e.g., 64Kbps), SONET/SDH firames are generated using fixed length packets repeated at intervals of 
125^S. 

25 At such a transfer rate, each byte of a SONET/SDH firame represents a basic telephony 

channel, often represented as DSO. A number of such bytes are reserved to fonn higher-order PDH signals 
(such as Tl) which use 28 DSO channels. One such method for supporting telephony channels is by 
dividing the payload into a number of virtual tributaries (VT). 

To achieve precise timing, PDH bytes must begin at the same o£&et inside a SONET SPE 

30 22a-22n. If data packets are transmitted along with the PDH channels, the data must be sent in the fixed 
length slots. ADocation of PDH channels at different locations inside the SONET SPE 22a-22n creates 
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fiagments of iinusBd bytes all over the SPE. If the slots B/DfF/G/H/l are used for variable-length data 
packets^ the slots cannot be fully used because the fixed bandwidth slots^ such as C and do not allow the 
packets to continue without fragmenting while crossiing slot boundaries. 

Two conventional approacheshave been used to accommodatehigh bandwidth signals along 
with low bandwidth signals. A first conventional approach is virtual concatenation. A second conventional 
approach is inverse multiplexing. 

Referring to FIG. 3, an example of a conventional virtual concatenation approach is shown. 
To transport fixed bandwidth traffic (e.g., T1/T3), the SONET SPE payioad area is divided into fixed 
timeslots (Le., virtual tributaries). An example of a virtual tributary is the standard VT1.5. A VT1.5 can 
cany 1.5Mbps of information for each tributary, which is equal to a Tl charmeL 

Allocation ofbandwidth for IAN data (such as 1 0/1 00Mbps Ethemet) using a SONET fiber 
network and VT becomes difficult. For example, one has to either dedicate an entire STS-1 (51Mbps), or 
use several VT charmels with inverse multiplexing (to be described in more detail in connection with FIG. 
3). 

Virtual concatenation combines several VT channels into bigger virtual pipes to carry higher 
bandwidth traffic. With such aprotocol, some virtual tributaries can carry T1/T3 data as usual while others 
are concatenated for transport of higher bandwidth data traffic such as 10/1 00Mbps. When many VT 
channels are concatenated, a ^tter pipe of a higher bandwidtii may be generated that can carry the entire 
bandwidth of a LAN. As a result, splitting a higher bandwidth into smaller VT channels and having to 
regroup them to get the LAN traffic can be avoided. However, virtual concatenation has one or more of the 
following disadvantages: 

(i) virtual concatenation allocates a fixed bandwidth for LAN, but cannot dynamically adjust 
bandwidth usage on a packet-by-packet basis; 

(ii) bursty LAN trafBc bandwidth usage is typically quite low, which can result in significant 
waste when used over a fixed bandwidth pipe (e.g., the average use of a 10Mbps link is 20% and, if an entire 
STS-1 is used, the efficiency becomes about 4%); and/or 

(iii) while some virtual pipe may be overloaded with traffic others may be underused (i.e., 
virtual concatenation cannot dynamically adjust network loads on different channels). 

Referring to FIO. 4» an example of the inverse multiplexing ^yproach for transmitting higher 
bandwidth channels is shown. Inverse multiplexing is similar to the virtual concatenation. However, 
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difiTerent SONET virtual tributaries (e.g., LINK#1-LINKSN) are not concatenated but are used as separate 
conduits of data transfer. 

Data fiom a high bandwidtli pipe, such as a 10Mbps Ethernet LAN, can be sent over the 
multiple VTl .5 tributaries LINK#1-L1NK#N usii^g inverse multiplexing. The data is later recovered using 
standard inverse multiplexing protocols. Inverse multipleDcing suffers fix)in the same problems ofbandwidth 
maximization as the virtual concatenation approach. In particular, bandwidth needs to be reserved in 
advance and all of the available bandwidth is not usable. 

In particular, inverse multiplexing suffers ftom one or more of the following disadvantages: 

(i) inverse multiplexing allocates a fixed bandwidth forLAN, but cannot dynamically adjust 
bandwidth usage on a packet-by-packet basis; and/or 

(ii) bursty LAN tra£Gic bandwidth usage is typically quite low, resulting in a significant waste 
when used over a fixed bandwidth pipe (e.g., if the average use of a 10Mbps link is 20% and if an entire 
STS-1 is used, then the efEciency becomes about 4%). 

Similar to virtual concatenation, while one VT (e.g., LINK#1) may be overloaded with 
traffic, other VTs (e.g., LINK#2-LINK#N) may be underutilized. Therefore, the bandwidth cannot be 
dynamically adjusted on different VT channels. 

Referring to FIG. 5, an example of ATM VP multiplexing is shown. ATM VP multiplexing 
provides anodier conventional approach to attempt to fully utilize SONET bandwidth. ATM VP 
multiplexing fills the payload area with ATM cells, where packets are encoded in ATM cells and then 
placed mside a SONET SPE. 

ATM Circuit Emulation Service (CES) is normally used for carrying PDH traffic such as Tl . 
Data packets are transmitted using Multiprotocol-over-ATM encapsulation methods. 

ATM VP multiplexing suffers from one or more of the following disadvantages: 

(i) operations, administration and maintenance (OAM) operations of an ATM network are 
different from that of a SONET network, and management of the two networks can become dijBQcult; 

(ii) ATM network routing and switch-to-switch signaling of data paths are different from IP 
network routes, resulting in network operational complexity; and/or 

(iii) a high percentage of network traffic consists of IP packets with small packet sizes of 
around 40 bytes. With DP over ATM (e.g., rfc2684 - Multiprotocol Encapsulation over ATM AAL5), 
payload size slightly exceeds what can fit inside a single ATM cell. Such an excess results in transmission 
of two ATM cells, with the second cell that is mostly ATM overhead and stuffing bytes. The transmission 
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of two ATM cells, along with other ATM overhead, requires allocating extra SONET bandwidth for IP 
transport. 

Refening to FIG. 6, various data tnmsmissions are shown in a SONBTring 30. Assume, for 
example, that a node A has ATM cells 14a-14n to transmit on the SONET ring 30. The SONET ring 30 
forms a SONET synchronous payload envelope (SPE), sets the PSL value for ATM cells (in the POH) and 
sends the SONET frame down a link 32a-32n. Even if the SPE is only partially full, the entire SPE frame 
size is transmitted. If a node B has IP packets to send, the node cannot use the partially filled SONET frame 
received from the node A to add POS packets, because the PSL value identifies only one type of data (ATM 
cells, in this example). The node must now wait I25|JiS for the partially filled packet to transfer down the 
link 32b-32n. Furthermore, the SONET ring 30 cannot handle Tl or T3 channels entirely in a payload 
space. The only way it can simultaneously support Tl A3 channels is by using virtual tributaries and by 
using some of the tributaries for non>Tl/T3 trafGc. 

Statistically, a significant percentage of network traffic comprises IP packets that are quite 
small in siz:e. Because higher-speed concatenated SONET fi^ames are large in size, many times a SONET 
SPE may not be completely filled with packets or cells at the origin. Because a SONET SPE carries only 
one type of data, the originating SONET node or other nodes downstream will not be able to add any 
different type of data to the SPE, and the SONET fi^me may be heavily imderutilized. Such an under- 
utilization of the SONET frame degrades the overall bandwidth utilization of fiber capacity with 
SONET/SDH. 

Referring to FIG. 7, a system 50 is shown implementing multiple fiber optic networks. The 
system 50 is shown implementing aTl network 52, an ATM network 54 and a POS network 56. Refening 
to FIG. 8, a timing diagram illustrating transfer times of the multiple data types of FIG. 7 is shown. 
Separate fiber networks for data types with current SONET protocols and separate fiber links are needed 
for transporting ATM, PDH traffic and variable-length packets such as IP or POS. PDH channels are 
created by strict timing relationships between coiisecutive Synchronous Transport Signal, Level 1 (STS-1) 
frames (to formasuperframe). Any intervening STS-1 frames containing ATM or POS packets will violate 
such timing specifications. 

Various conventional protocols have been developed to improve bandwidth usage by 
attenq)ting to partially solve two problems in SONET networking (i) lack of support for data mixing, and 
(ii) bandwidth reuse limitations. Such conventional protocols have been partially able to achieve additional 
bandwidth either by creating fatter pipes with VT, by filling a payload with ATM cells carrying different 
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types of data, or by using a SONBT HnV as a multi-node access network using Bthemet framing for data 
packets. 

While virtual tributaries provide an efficient way to transport PDH traffic, allocation of 
bandwidth for LAN data such as 10/1 00Mbps usiag a SONET fiber containingTl trafficbecomes difficult 
5 To support 10Mbps through Virtual tributaries one has to either dedicate an entire STS-1 (5 1Mbps) frame, 
or use several virtual tributary channels and to perform inverse multiplexing. 

Virtual concatenation concatenates several VT channels into bigger virtual pipes to carry 
higher bandwidth traffic. With such a protocol, while some virtual tributaries carry T1/T3 data as usual, 
others are concatenated for transport of hi gher bandwidth data traffic such as 1 0/1 00Mbps links. 
10 However, virtual concatenation allocates a fixed bandwidth for LAN, Virtual tributaries 

cannot dynamically adjust bandwidth usage on a packet-by-packet basis. While it is possible to change the 
concatenated bandwidth through software, such an inc^lementation does not yield much for bandwidth 
utilization. Bursty LAN traffic bandwidth usage is typically quite low, resulting in significant waste when 
used over a fixed bandwidth virtual pipe (average use of a 10Mbps link is 20%, and if an entire STS-1 is 
15 used the efficiency becomes about 4%). Another problem with virtual concatenation is that while one 
virtual pipe may be overloaded with traffic, others may be underutilized. Virtual concatenation cannot 
dynamically adjust network loads on different chaimels. 

Another conventional approach to increase the utilization of SONET bandwidth is to fill the 
payload area with ATM cells using a technique known as ATM VP (Virtual Path) multiplexing. AIM VP 
20 multiplexing encodes packets m ATM cells and then inserts the cells inside a SOlSfET SPE. The ATM VP 
multiplexing typically utilizes CES to carry DSO/1 PDH traffic. 

However, operations, administration and maintenance (0AM) operations of ATM networks 
are different from that of SONET, and management of the two protocols can become difficult. Similarly, 
ATM network routing and switch-to-switch signaling data paths are different from IP network routes, 
25 resulting in network operational complexity. 

Networic traffic statistics monitoring has shown that a significant percentage (about 45%) 
of network traffic comprises IP packets with small packet sizes (e.g., around 40 bytes). With IP over ATM 
(rfc2684 - Multiprotocol Encapsulation ov&r ATM AAL5) payload size slightly exceeds what can fit inside 
a single ATM cell. Such an arrangement results in transmission of two ATM cells, with the second cell that 
30 is mostly ATM overhead and stuffing bytes. This, with other ATM overheads, means having to allocate 
extra SONET bandwidth for IP transport if ATM is used as a transport protocol. 
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In addition, using ATM for sending different services requires implementation of ATM 
transport protocols and interwoiking for all related protocols (such as IP-over- ATM, Frame Relay-ATM 
Intemetwoiidng, circuit emidation, etc.) in the device. Such implementation requires a high level of 
complexity in hardware and software, resulting in higher costs of manufacturing and operation of networks. 
5 Such conventional network architectures are not efficient for transmitting variable-length 

IP packets that form the majority of data network traffic on the Internet. Data netwodc trafiSc comprises 
variable-length IP packets and fixed-length ATM cells (i.e., 53 bytes). 

As more and more data is being transported on SONET/SDH rings, there is a need to send 
variable-length packets on pre-existing SONET/SDH networks. These packets originate out of routers and 
1 0 other data access devices. While SONET/SDH networks must transport these data packets, they must also 
. continue to support TDM-style jQxed length packets for telq>hony and leased line applications. 

Conv^itional ^preaches cannot mix POS with ATM cells in a single SONBT SP£. 
Conventional approaches do not leave some area of the SONET SPE reserved for VTs and others for POS 
and/or ATM cells. 

15 Limitations of conventional approaches include one or more of the following (i) inability to 

mix TDM channels with packet-oriented data over S ONET/SDH rings due to timing constraints of the TDM 
channels without a fixed bandwidth virtual tributary mechanism and (ii) limiting data channels sent on fiber 
carrying Tl lines to Virtual tributaries (since virtual tributaries are of fixed bandwidth, this restriction limits 
data channels to fixed bandwidth operation). 

20 Therefore, if a SONET SPE is carrying all ATM cells, it cannot carry IP variable-length 

packets, and vice versa. Such switches route all packets coming at one tributary to another until switching 
paths are changed througih reprogramming. 

Conventional approaches do not take into account network loading conditions and do not 
support dynamic bandwidth provisioning. Conventional approaches also have increased traffic on core links 

25 from too much concentration into too few links. Transporting IP traffic over virtual tributary channels that 
was originally designed for DSO/1/3 connectivity is inefficient. Because VT assignment is fixed, IP 
transport is not able to take advantage of total available SONET/SDH bandwidth. 

In conventional approaches, IP packets are constrained to go through some pre-configured 
VT channels while other VT channels may be under-utilized. Once a VT dumnel is dedicated for a 

30 particular traffic and is put on a specific circuit-switched path, the topology does not change, even if traffic 
conditions change. 
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Conventional approaches have the following disadvantages (i) ATM and Packets are 
implemented on different rings because of QoS and timing issues; (ii) very high cost for new fiber and 
SONET equipment for Telco/ISP/MAN; (iii) only one type of packet goes inside a SONET SPE at one time 
(the remaining hytos of the fi:^me with conventional SONET are wasted) (SONET packets go around the 
entire SONET ring, limiting bandwidOi); and/or (iv) the only way to support telephony channels along with 
data packets is to allocated part of SONET frame for packet data transmissions (which results in an 
ine£&cient bandwidth usage). 

Summary of the Invention 

One aspect of the present invention concerns a frame configured to (i) be transmitted on a 
netwoik and (ii) store data packets in a plurality of channels. One or more of the plurality of channels may 
be configured to store one or more firagments of the data packets. 

Another aspect of the present invention comprises an apparatus comprising one or more 
nodes coupled to a network. Each node may be configured to receive and/or transmit one or more of a 
plurality of frames. Each of the pliurality of frames may be configured to store data packets in a plurality 
of channels. One or more of the charmels may be configured to store one or more fi:agments of the data 
packets separated by an offset pointer. 

The objects, features and advantages of the present invention include providing a method 
and/or architecture that may (i) provide a single SONET ring to carry a number of forms of data; (ii) allow 
a number of fonns of data types to operate inside a single SONET SPE; (iii) permit filling of a fixed size 
payload area of a SONET/SDH network with data packets along with fixed bandwidth channels, (iv) allow 
fine-tming of the available bandwidth of SONET/SDH to get exactly the T1/T3 bandwidth (or a fraction 
thereof, down to DSO bandwidth of 64kbps) required while using all of the remaining bandwidth for data 
packets, (v) provide bandwidth reuse at various nodes of a network; (vi) allow SONET sub-sections to run 
at frill speed, effectively boostmg SONET bandwidth; and/or (vii) provide a significant savings in 
equipment and fiber optic infrastructures. 

Brief Descri ption of the Drawings 

These and other objects, features and advantages of the present invention will be apparent 
from the following detailed description and the app^ded claims and drawings in which: 

FIG. 1 is a detailed block diagram of conventional fiber optics transmission data types; 
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FIG. 2 is a block diagram illustrating conventional transportation of higher bandwidth data 

packets; 

FIG. 3 is a block diagcam illustrating conventional transportation of higher bandwidth data 

packets; 

FIG. 4 is ablock diagram illustrating inverse multiplexing for transporting higher bandwidth 

data packets; 

FIG. 5 is a block diagram illustrating conventional transportation of higher bandwidth data 

packets; 

FIG. 6 is a more detailed block diagram of the circuit of FIG. 4; 

FIG. 7 is a block diagram illustrating a conventional multiple fiber optic network system; 

FIG. 8 is a detailed block diagram illustrating a conventional timing op^tion; 

FIG. 9 is a block diagram of a preferred embodiment of the present invention; 

FIG. 10 is a more detailed block diagram of the circuit of FIG. 9; 

FIG. 1 1 is a block diagram of a HDT frame inside a SONET SPE; 

FIG. 12 is a block diagram illustrating transportation of higher bandwidth data packets; 

FIG. 13 is a detailed block diagram of an operation of the present invention; 

FIG. 14 is a detailed block diagram of a variable length envelope; 

FIG. 15 is a block diagram of a packet of FIG. 11; 

FIG. 16 is a more detailed block diagram of a header of FIG. 9; 

FIG. 17 is a flow chart illustrating an operation of the present invention; 

FIG. 18 is a flow chart illustrating an operation of the present invention; 

FIG. 19 is a flow chart illustrating an operation of the present invention; 

FIG. 20 is a block diagram illustrating an implementation of the present invention; and 

FIG. 21 is a block diagram illustrating an operation of the present inventioiL 

Detailed Description of the Preferred Embodiments 

The present invention may provide a Hybrid Data Transport CHDT) protocol that may allow 
transmission of iSxed bandwidth channels (e.g., Tl/T3)> variable-bandwidth data sources (e.g., ATM), IP 
and any other protocol data in a single SONET frame using a single fiber network. The protocol of the 
present invention may work seamlessly across a mix of SONET and non-SONBT networks; and may yield 
cost savings in fiber infrastructure, equipment, and operation. 



wo 01/69834 



11 



PCT/USOl/07780 



With the use of the Hybrid Data Transport (HDT) protocol of the present invention, an 
existing fiber network may be fully utilized to transport amnnber of differenttypes of traffic. The present 
invention may additionally dynamically manage bandwidth usage on a packet-by-packet basis. 

The present invention may provide spatial reuse of bandwidth, allocation ofPDH bandwidth 
5 in 64Kbps increments, protocol-independent MPLS ^ulti-Protocol Label Switching) support, and/or 
seamless operation over point-to-point and ring networks with SONET/SDH, direct data-over-fiber 
configurations or other network configurations. The present invention may also be appKcable to 
Synchronous DigitalHierarchy(SDH). However, SONET is used as ageneral description for SONET/SDH 
networks with similar implementation for SDH networks. Additional details of the operation of the HDT 

1 0 protocol are also described in connection with direct data-over-fiber networks. 

Referring to FIG. 9, ablock diagram of a system 1 00 is shown in accordance with apreferred 
embodiment of the present invention. A more detailed implementation of the system 100 is illustrated in 
FIG. 10. The system 100 may comprise a number of devices 102a-102n connected to a network backbone 
104. FIG. 10 illxistrates the addition of amnnber of chips 106a-106n. The devices 102a-102nmay receive 

15 Tl/rS signals, ATM signals, and POS signals. The devices 102a-102n may receive data in one or more of 
the following data transmission media: SONET, SDH, direct data over fiber (e.g., both in point-to-point or 
ring configuration) with or without SONET/SDH framing and other transmission methods needed to meet 
the design criteria of a particular implementation. 

The system 100 may provide an increase in die data traffic handling c£^abilities of 

20 SONET/SDH networics. The system 100 may implement a design of a SONET/SDH add/drop multiplexer 
(ADM) (and a SONET/SDH cross-connect) that may function on variable-length packets. With such an 
approach, IP (or other protocol) packets of different lengths may be (i) added to a SONET/SDH SPE and 
(ii) terminated at a different network node (e.g., devices 102a-102n). 

Refeiring to FIGS. 1 1 and 12, a detailed block diagram of SONET/SDH payload envelope 

25 (SPE) 200 is shown. The present invention may embed a header (and/or footer) 202 (e.g., a 32-bit packet 
header) to create a deterministic packet transport protocol. The packet header may comprise a 32-bit 
payload header 204a-204n that may precede each frame, regardless of the particular packet type stored 
within the frame. The protocol identification may be implemented as a few header bits configured to denote 
the particular type of packet (e.g., ATM, IP, PPP, Frame Relay, etc.) embedded within the payload portion 

30 of a particular firame. B andwidth maximization may be implemented with another bit in the header 202 that 
may specify whether the packet may be reused by the intermediate SONET nodes 102a-102n. TheSONET 
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firaming may be left imchanged by implementing a sin^e PSL (Path Signal Label) value 206 in a SONET 
Path Over Head (POH) 208 that is generally able to specif the various types of packets embedded within 
the payload of a particular frame. The system 100 may be directly applicable to WDM/DWDM Fiber 
because individual packet framing is independent of SONET. The system 100 may be also used in 
5 IP-over-Fiber networks. 

In FIG. 12, a more detailed example of the frame 200 is shown illustrating packet 
fragmentation across frxed bandwidth channels in accordance with the present invention. The frame 200 
leverages the fact that SONET/SDH frames are normally synchronous in nature and that frame bytes are 
nomially transferred in a single sequence within a timed window. 

10 An optical node may receive bytes from a synchronous frame (e.g., the frame 200) and 

generally have access to all tiie bytes in the particular SONET/SDH frame. Theparticular frame is generally 
of a fixed size (e.g., for a given SONET/SDH speed and type). The frames may be clearly marked and are 
normally accessible in a definitive mianner using path overhead and line overhead markers. 

Instead of creating fixed bandwidth pipes by using virtual concatenation or implementing 

15 fixed-bandwidth inverse multiplexing pipes (as in conventional approaches), the system 100 may have 
different types of packets to span over available spaces inside particular SONET/SDH frame. The system 
100 may provide an encapsulation 210 around the payload 212 that generally contains additional 
information about the packet. 

Available space may be filledin with datapackets as usual. When a particular packet cannot 

20 beplaced fiiUy in the available space (e.g., because of animpending frxedbandwidth channel) the particular 
packet may be firagmented and may be continued in the next available space. A packet (or a packet 
fragment) generally contains an ofiset (to be described in more detail in connection with FIG. 13) that may 
point to the beginning of the next frame where the remainder of the packet is stored. The offset may be 
implemented, in one example, as a 32-bit offset field at the end of the packet The of&et may mark the 

25 particular location where the packet is continued after the current end of frame. 

Depending on available space, a particular £*ame may be coiiq)letB inside a SONET payload 
comprising outside framing bytes. Li traditional intemet protocol fi-aming, any fragmentation may require 
each fragment to carry most of the IP header bytes with sequencing information. The sequence information 
allows the fragments to be reassembled. 

30 Intemet protocol may allow a plain offset value to link the next packet fragment to the 

previous packet fragment within the frame. The continuing packet fi»gment(s) do not generally need 
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internal header data repeated since the packet &agm6nt(s) reside in a single SONBT/SDH frame 100 and 
are transmitted in sequence within a synchronous frame. 

The firame 200 may permit filling of a fixed size payload area of SONBT/SDH with data 
packets along with fixed bandwidth channels such as T1/T3 . The firamc 100 may reduce and/or eliminate 
5 bandwidth limitatLons imposed on data packets in fixed bandwidth channels. 

The firame 200 may provide a savings in equipment and fiber optic infirastnictures. The 
fi^me 200 may permit fine-tuning of the available bandwidth of SONET/SDH to provide the bandwidth 
required for T 1/T3 while using the remaining bandwidth for data packets without requiring complex inverse 
multiplexing or virtual concatenation techniques. 
10 The fi:am6200may provide advantages that may (i)pem3it filling of a fixed sizepayload area 

of a SONBT/SDH network with data packets along with fixed bandwidth channels, (ii) allow fine-tuning 
of the available bandwidth of SONET/SDH to get exactly the T1/T3 bandwidth required while using all of 
the remaining bandwidth for data packets, and/or (iii) provide a significant savings in equipment and fiber 
optic infirastructures, 

1 5 The SONET/SDH payload envelope 200 (e.g., transmitted every 125jaS) maybe divided into 

variable length packets. The header 202 may comprise one or more of the following parameters: (i) packet 
length, (ii) length of CRC (Cyclic Redundancy Check), (iii) payload idaitifier header to describe the nature 
of packet, (iv) route labels that may help route packet inside network, (v) payload header CRC, (vi) actual 
payload, and/or (vii) payloads CRC, 

20 In SONET, a basic unit of transmission is a Synchronous Transport Signal Level 1 (STS-1) 

or Optical Carrier Level 1 (OCl) signal. Both operate at 51.84 Mbit/s. STS-1 describes electrical signals, 
and OCl refers to the same traffic after being converted into optical signals, SONET also allows channels 
to be multiplexed. An OC12 circiiit, for instance, may carry traffic from four 0C3 links. An 0C12 circuit 
may also carry a single channel, in which case the line is said to be concatenated. Such circuits may be 

25 described as OC3c, 0C12c, and so on. 

Another protocol similar to SONET is Synchronous Digital Hierarchy (SDH), defined by 
the ITU (IntemationalTeleoornmunication Union) as G.707 (shortly after ANSI fonnally ratified the T.105 
spec for SONET)/ Although intercozmection of SONET and SDH networks may be relatively rare, several 
new transoceanic telecommunicatiotis projects make use of such links. 

30 The system 1 00 may maximize fiber bandwidth by implementing the Hybrid Data Transport 

(HDT) Protocol. The HDT protocol may allow dynamic management of packets to maximize bandwidth. 
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The system 100 may allow the transport of different types of data over asingle fiber link. With the system 
100, IP (or other protocol) packets, Packet-Over-SONET (POS), ATM cells, G.702-based PDH (T1/T3), 
SRP, Frame Relay, and other types of data may be mixed inside a SONET payload and dynamically and 
sent on a single fiber (as shown in FIGS. 9 and 10). The system 100 may provide robust scrambling and 
unified packet transport over ring and point-to-point networks and may be well suited for non-SON£T 
configurations such as pomt-to-point WDM networks. The SONET SPE 200 may be filled with HDT 
frames that may carry a wide mix of fixed and variable bandwidth data. The Simple Data Link (SDL) 
framing protocol prefixes a payload with a 32-bit word, 16 bits of which hold the length of the packet and 
the other 1 6 bits contain CRC (Cychc Redundancy Check) for the length field. SDL may provide a robust 
CRC-1 6 based framed boundary delineation mechanism compared to hybrid mix of point-to-point and ring 
topologies. 

The syst^ 100 may implement a single fiber link that may be used for sending different 
kinds of traffic to use the fiill cqiacity of the link. The system 100 m^ allow VT or sub-VT channels to 
be eliminated. ATM cells, IP (and other protocols) packets, PPP, frame relay, NxDSO, T1/T3 and others 
may be mixed inside the SPE on a packet-by-packet basis. 

PDH channels (such as Tl/El) maybe dynamically allocated anywhere inside the SONET 
payload in 64Kbps bandwidth increments. Bandwidth may be reusable in fine granularity in 64Kbps 
increments, with any type of data. For example, an IP packet may be dropped at a node (e.g., B) where the 
node B may reuse the packet area for inserting ATM cells, fi:ame relay, PDH traffic, or any other data type. 

The system 100 may transport many packets of one or more different data types. The 
particular type of data may be placed inside a single SONET SPE or data-over-fiber frame while preserving 
time dependency of datapackets, such as PDH. The system 100 may be implemented without terminating 
the whole link capacity at each node. Destination nodes may indicate a start of the packet inside a SONET 
payload. Other packets may pass through the node. 

Direct data-over-fiber configurations (e.g., without SONET framing) may be easily supported 
with full link monitoring and management. Support may also be provided for variable-size packet SONET 
add^drop multiplexer (SONET ADM) devices. Variable-size packets may be transported inside a SONET 
SPE and nodes may cross-connect and add/drop the packets on different ports. 

The system 100 may provide protocol-independent transport of MPLS labels. The HDT may 
provide for transmission of MPLS labels outside of protocol frame (rather than embedding such labels 
between data link and network layers as in conventional approaches). Intermediate SONET and optical 
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fiber nodes may be used to create switching and add/drop systems without having to become 
protocol-aware. 

With provision for MPLS labels transported outside of packets, the HDT may allow setting 
up of fast-reroute fail-switchover paths over a hybrid of ring and point-to-point networks using MPLS 
5 labels, without requiring nodes to be protocol-sensitive. Such an implementation may eliminate the need 
to provision and reserve completely miused backup paths on SONET rings. 

In operation, the payload headers 204a-204n may precede every packet to carry the 
information to support HDT. A uniform structure of the header across a variety of packet types generally 
simplifies design of optical nodes for packet processing for both SONBT and direct data-over-fiber 
10 networks. The headers 204a-204n may also contain a reusability bit that is set by the sending node. If the 
reusability bit is cleared, a destination node may reset the data identification bits to firee xxp the packet area 
for reuse by new data packet. The packet area may be reused at either at the destination node or other 
downstream nodes. 

Referring to FIG. 13, an example of an offset locator operation 230 for a next packet 

15 fragment location is shown. An offset pointer 232 may point to a header location 234 in the frame where 
the next portion of the packet is stored. A packet may have a number of offset pointers if the packet is stored 
in a number of locations. By breaking packets into fragments, the frame 200 may be frilly loaded prior to 
transmission. The firame 200 generally works with packets, rather than frame divisions, and may fully 
utilize available bandwidth. The firame 200 may provide dynamic allocation of data packets inside 

20 SONET/SDH payload for maximum efficiency. Particular packet encapsulation may include details &om 
HDT framing and may show the of&et word at the end of fimne. 

By using the payload header 204a-204n to id^tify the type of apacket, the HDT is generally 
able to extend data identification beyond PSL-based SPE-level data typing and put multiple data types 
inside a SONET SPE. A value of 0000 may indicate the packet area (e.g., the length of the packet area is 

25 given by the length value in the outside SDL framing) that does not generally contain any useful data and 
can be reused for storing new data, HDT may easily support traditional PDH and other guaranteed 
bandwidth channels. In SONET networics, a frame repeats every 125 |iS, resulting in abandwidth of 64KHz 
for every byte in the payload. By fixing the starting location of some packets inside the SONET frame, slots 
may be created for sending* TDM-style traffic. Because the packet length is changeable in one-byte 

30 increments, such slots may be created in increments of 64KHz. Because packets are dynamically created, 
fixed bandwidth channels may be created on the fry by clearing the reusability bit in the payload head^. 
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Referring to FIG. 14, a detailed block diagram of the SONET SPE 200 is shown. The 
SONET SPE 200 may comprise a nnmber of packets 220a-220n and anumber of empty packets 222a-222n. 
The packet payload header 204a of the packet 220a may identify the packet/protocol. The packet payload 
header 204amay identify apacket type of the packet 220a stored (or transported). The payload header 204a 
may tell what kind of packet/protocol (such as Ethernet. PPP, IP, Frame Relay, ATM cells, Tl, etc.) is 
inside a payload of the packet 220a. Different protocols may be si^ported at two ends (e.g., the devices 
1 02a-102n) of a network without the need for provisioning in advance. In contrast, conventional approaches 
use a protocol over WAN which is usually negotiated between two parties at the ends devices 1 02a-102n 
oftheWANhnk. 

The p ayload header 204a may be used to tell whether one or more of the empty p ackets 222a- 
222a inside the SONET SPE 200 may be reused at an intomediate node. In contrast, in conventional 
SONET networks, Ihe entire SONET SPE 200 travels around the ring until removed by the sender. With 
the system 1 00, a receiver may mark the SONET SPE 200 as reusable. Nodes on the fiber network 1 00 may 
mark different sections of the SONET SPE 200 as reusable by the other nodes 102a-102n. 

Provisioning of TDM channels may provide the ability to mark a portion (or many portions) 
of a SONET SPE payload area as non-reusable. With a non-reusable area, even when a receiver receives 
the packet, another receiver cannot reuse the packet area. However, the same receiver may reuse the non- 
reusable area. 

In general, there is no limit to the order and manner of packet positioning. Any packet may 
be marked in any fashion to si^port, for example, a dynamic mix of data and voice (TDM) trafQc on a 
SONET/SDH network. Such an implonentation is not possible with current technologies. The present 
inventionmay solve the problem of mixed value and data transmissions faced by telephone carriers and data 
providers. 

As SONET frames containing fixed bandwidth channels move aroxmd the ring, intermediate 
nodes may detect these packets (e.g., the reusability bit is reset), note the offsets of these packets, and 
preserve the respective offsets when recreating the frame (e.g., after adding packets from local input ports) 
for outbound traffic. 

Referring to FIG. 15, a detailed example of a packet is shown. An SDL framing 262 may 
be in the first 16 bits and may contain the length of the entire payload, including SDL framing bytes. A 16 
bits of CRC-16 264 may be provided on the length field (e.g., xl6 + xl2 + x5 + 1). The payload header 
204a-204n may be a 32-bit word, followed optionally by an OAM bytes or MPLS labels 268. MPLS/OAM 
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bytes may be variable number of MPLS labels or OAM values that may be transmitted in the header area 
of HDT, outside of the payload. A next fragment offset 270 may be a 1 6-bit value showing the location 
ofGset of a next packet fragment (if any) of the packet. The next fragment of&et 270 is generally taken from 
the start of a current packet A header CRC 272 may be computed over payload header bytes only, with 
5 same scrambling polynomial used for SDL framing. A payload area 274 may contain the actual packet to 
be transmitted over the WDM or SONET link. The payload area 274 may contain one of a number of types 
of protocol packets, such as Ethernet, ATM, GR.702, PPP, Frame Relay, etc. A payload CRC 276 may be 
user-controlled value and may be computed for the payload bytes only. The payload CRC 276 is generally 
either a 16 or 32-bit value, depending on mutual negotiation between sending and receiving stations. 

10 Referring to FIG. 16,variousparametersofthepacketheader204aareshown. Theparticular 

bit width of the payload head^ 204a may be varied accordingly to meet the design criteria of a particular 
implementation. A packet id^tifier 280 (e.g., D3: DO) generally idmtifies the type of packet in the 
payload. For example, a value of 0000 may represent a null packet. A null packet may indicate that the 
payload area may be reused. When a packet is dropped at a node, the length field does not generally need 

15 to be modified for the packet, only the D3: DO bits need to be cleared, 

A header data area 282 may carry MPLS labels (e.g., outside of payload area). Operation 
administration and maintenance (OAM) bytes 282 may be used for link management, or any other data 
separately from the payload. A reusability area 284 (e.g., D7) may be a "1". If a SONET node can reuse 
a particular packet area, the size of the packet area may be given by the packet length field 264 of the SDL 

20 header. If the bit D7 is set to a "0**, then a node will not generally mark the packet area as re-usable, even 
after a packet has been dropped. The particular ncxles of the various configuration bits may be varied (e.g., 
invoked) accordingly to meet the design criteria of a particular implementation. 

A header length area 286 (e.g., D15: D8) may include, in one example, a 32-bit payload 
header. A firagment identifier area 288 (e.g., D17: D16) may be implemented as atwo word value. A value 

25 of "00" may indicate that the payload area contains a complete packet A vahie of "01" may indicate the 
begimiing packet of a fi'^mentation sequence. A value of "10" may indicate a continuation of packets. 
A value of "1 1" may mark the last ^cBgpicnt in the series. Other particular bit patterns may be implemented 
accordingly to meet the design criteria of a particular hnplementation. 

A padding area 290 (e.g., D18: D19) may indicate a minimum packet length. In one 

30 example, the minimum packet length may be 4 bytes (e.g., 2 bytes length + 2 bytes CRC). Idle bytes at the 
end of packets and elsewhere may be marked by a length field of ''OOOO*', In instances there may be less 
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than 4 bytes left between packets. In this case, it maybe impossible to place a SDL null packet. Such idle 
bytes axe shown as tail-end padding for the preceding packet. An unused area 292 (e.g., D31:20) may be 
used for additional expansion. 

Referring to FIG. 17, an example of a receive operation is shown. A node may receive a 
5 fiame at a block 300. A block 302 may determine if the received frame is an HDT frame. The block 302 
may use the PSL value in the POH to determme the t5^e of protocol carried mside the SPE. If the PSL 
shows POS, ATM, or PDH traffic, the receive operation may proceed to the block 304. If no HDT packets 
are present, a block 306 handles the POS/ATM/PDH packet. If in the block 302, the PSL shows the SPE 
contains HDT frames, the node uses additional logic for HDT processing to detect and route different types 

10 ofpackets embedded in the SONET SPE 200. 

A block 308 may read the POH. A block 310 may determine a first packet of the SONET 
SPE200. Ablock312mayreadalengthandCRCofthefrrstpacket. Ablock314may detemoineamatch 
of the length and the CRC. If a non-ihatch of the length and CRC occurs, the receive operation is generally 
settoablock316. Theblock316may readanextwordofthepacketfromthe SONETSPE318. Ifamatch 

15 occurs, the receive operation may process the packet. Once the payload header has been processed and 
different packet types are been processed and diffCTent packet types are identified, hardware (e.g., 
implemented in the system 1 00) may use header fields to retrieve the payload and use usual hardware blocks 
for processing. 

ATM cells are generally retrieved by first looking at the PSL value to determine their 
20 presence and then reachnig the SONET SPE to get fixed byte ATM cells, either with or without HEC-based 
cell delineation. For example, if the payload header in the HDT shows the payload contains ATM cells, the 
hardware device generally retrieves payload bytes (up to number of bytes specified in length field) and 
sends the byte stream to an existing ATM cell processing logic. The ATM cell processing logic may then 
work on the b3^e stream using HEC hunting just as if the SPE contained only ATM cells in its payload. 
25 Referring to FIG. 18, an example of a processing operation 320 is shown. A device 

supporting Hybrid Data Transport HDT protocol generally operates much the same as a normal 
SONET/SDH transport operates. Opaations for processmg ATM cells, POS, and PDH protocols are the 
same and illustrated as processing blocks 350, 352 and 354. HDT adds a header to packets to allow their 
mixing within tiie same SPE 200. Much of the HDT processing is generally related to processing of the 
30 header to identify the type of packet and then passing the starting address of data bytes to standard logic for 
handling the iruiividual packet type. Support of PDH-type charmel typically requires a fiixed starting 
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location for the channel in every frame. If PDH support is not needed, packets of any mix may be put 
an3^here inside the SPE 200 to achieve excellent bandwidth utilization without much operational 
complexity. When fixed bandwidth channels are canied, some data packets may need to be fragmented 
when the packet hits a static location. Fragmentation of a packet however, is generally easily achieved in 
5 SONET netwoiking because aU bytes in the SPE 200 are transmitted sequentially. Additionally, recovering 
fragments and putting the fragment together may be simply accomplished. 

Referring to FIG. 19, an example of a transmit operation 400 is shown. A device supporting 
HDT may receive a packet to be transmitted from a system side. In the transmit operation 400, a node may 
take inputs from different sources 402, encapsulate the packets with an SDL length/CRC fields 404. add an 

10 HDT header 406 to each of the packets, and then store the packets inside the SPE. The node may not send 
a fresh fi:ame on the network in order to transmit the packets. A TDM channel check 408 may determine 
a reusability of the SPE 200. The transmit operation 400 may reuse available space in an incoming SPE 
(containing HDT frames). The transmit operation 400 may then may proceed to a length check 410 to see 
if there is any space available to insert the packet to be\ent. If there is enough space, the entire packet is 

1 5 stored (with proper SDL framing and HDT header bytes). Any remaining bytes, depending on the size, are 
generally either (i) filled with a null HDT packet (e.g., the payload header identification bits are 0000), (ii) 
filled with SDL null padcets (e.g., pairs of length/CRC with a null length field), or (iii) accounted for as tail- 
end padding (e.g., if the size is less thau 4 bytes). 

If the transmit operation 400 runs into a fixed-bandwidth channel allocationmidway through 

20 the packet allocation, the packet is generally fragmented. In this case, a portion of the packet may be stored 
at one place and other fragments may be stored at another free location. The first firagment offset pointer 
may contain the starting location of second fragment. Because bytes are transmitted sequentially in the SPE 
200, reassembling fragments may be easily achieved. 

If a particular node detects an incoming SONET frame on a receive port, or if there is a fi-ame 

25 in the transmit^receive queue, the node checks the frame to see if there are unused/reusable areas in the 
incoming/queued frame that can be used for sending data. If there is enough space available in the frame, 
the node fills the ^ace with additional data before sending the frame out. 

In HDT, PDH channels of any bandwidth (up to allowable SONET bandwidth limits) may 
beprovisioned anywhere inside the SONET SPE. To achieve precise timing, PDH bytes must bcgiii at the 

30 same offset inside the SONET SPE. However, allocation of PDH chaimels at different locations inside a 



wo 01/69834 



20 



PCT/USOl/07780 



SONET SPE may CTeate fragments of unused bytes all over the SONET SPE. For efficient transport of 
variable-size IP packets, these unused bytes may be utilized for IP data. 

Referring to FIG. 20, an operation 500 for CRC eiror checking is shown. If bit enx)rs occur 
at an upstream node that receives a packet with a correct CRC, the downstream node will never learn about 
the bit errors if the upstream node recomputed CRC for the packet before transmission. When MPLS is 
used, a node that receives the packet usually swaps the label with a different value, pops the label, or adds 
a new label to the stack. If MPLS is embedded inside a packet, payload CRC wiU change at each node. 

One solution would be to check for CRC for ingress, but not to re-compute the CRC on 
egress. An efficient way to implemait such CRC computation is to separate header CRC from payload 
CRC. This way. header CRC is recomputed easily and quickly at intermediate nodes while the payload 
CRC is preserved end-to-end. With HDT, all header labels and other temporary information for the packet 
may be carried outside of the payload so the payload data/CRC is not modified at any of the intermediate 
nodes. 

A SONET node may be a data-aware add/drop multiplexer, a digital cross-connect, or a 
router/access miiltiplexer sitting on a SONET ring. Such devices may implement HDT protocol for data 
encapsulation and transport over SONET and WDM networks. Traditional circuitry for ATM cell 
delineation, PPP processing and other protocol handling may be implemented similar to conventional 
approaches^ with some additional added circuitry for HDT encapsulation and dec^sulation. Thepath signal 
label (PSL) value proposed for use with the HDT may be the same as the one for SDL frames. 

Referring to FIG. 21, an example of spatial reuse with HDT is shown. Spatial reuse of 
bandwidth across a number of network nodes (e.g.. A, B, C, D) may be achieved by permitting full or partial 
termination of individual packets at any node. Spatial reuse of bandwidth reclaimed from the terminated 
packet may increase performance. HDT may provide an ideal way to achieve spatial reuse of SONET 
bandwidth- Using add/drop of hybrid data, nodes can reuse released bandwidth for transmission of any of 
the various kinds of data. 

As the SONET SPEs are received at the nodes A, B, C, D, initial bytes may be placed in a 
small transit buffer. Through MPLS labels contained in the header section or through internal packet fields, 
a particular node A, B, C, D may be able to determine whether the packet belongs to the node. If the packet 
does not belong to the node, the bytes are streamed out of transit buffer to the ou^ut port However, the 
packet may belong to the node A, B, C, D if, for example, (i) the D7 bit is set in the payload header, (ii) the 
packet area has beea reserved for a fixed bandwidth channel such as a PDH, and/or (iii) in this case, the D3 : 
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DO bits are not cleared If the D7 bit is set to "0", the node may clear the D3: DO field to msak the packets 
void and reusable, where the bytes belonging to the packet are sent to system. The number of bytes sent 
to the system may be specified in the length field of the SDL header. If the header shows fiagmentation 
then a packet is received in many fragments and sent out to the system until the last fragment is received. 
5 Packets may be added either using a fresh SONET SPE or by reusing bytes ixisidc an 

incoming or previously queued frame. The decision of which packet to add to a void or reusable packet area 
inside an SPE can be made on following lines by (a) selecting a packet (or a collection of packets) that will 
fit inside the reusable area, (b) selecting all packets that can fit inside the reusable space, or (c) selecting 
a packet based on QoS parameters or packet priority. Since SONET frames repeat at L25ms intervals, 

10 packet transmission may be arranged to achieve a desired rate. Once a packet is selected for addition to the 
SPE, the node creates a payload header by setting payload type, reusability and other bits for the packet. 
The circuit 100 may then add the header to the payload. 

The SDL framing mechanism may use length/CRC pair information as a header and a frame 
delimiter. SDL provides a robust scrambliag and frame locator technique and may be used for direct 

15 data-over-fiber networks where SONET framing may not be used. Implementing OAM packets may 
eliminate the need for complex SONET framing and link management overheads. In the example of direct 
data-over-fiber networks, the HDT protocol structure may operate unmodified. Point-to-point WDM 
networks and ring-based SONET networks (or any other network) may easily be mixed and connected to 
each other. With a powerfiil support for MPLS (that may be transported independently of payload), 

20 networks may be designed that may have altemative LSP (Label Switched Paths) links for a highly robust 
redundancy. For example, nodes on a SONET ring may be coxmected through another network that may 
be entirely different from the ring. The backup path could be a high-speed point-to-point link or a ring 
network that may be geographically quite diverse. By providing a common network protocol engine, the 
HDT protocol may permit configuration of these networks quite easily without requiring complex protocol 

25 translation logic for different network configuration. 

The present invention may use a packet payload header to identify the kind of packet inside. 
These identifier bits tell what kind of packet/protocol (e.g., such as Ethernet, PPP, IP, Frame Relay, ATM 
cells, Tl» etc.) is inside the payload. Using such a technique, different protocols may be supported at two 
ends without the need for advanced provisioning. Using conventional methods, the use of a single protocol 

30 over a WAN needs to be negotiated. 
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The identifier may indicate whether one or more packet areas inside SONET SPB may be 
reused at an intermediate node. Conv^tional SONET networks require the SONET firame to travel around 
the ring until removed by the sender. Even when the receiving node received a packet, the firame went 
around the network, wasting bandwidth. With the present invention, not only may a receiver mark a 
SONET SP£ as reusable, but differentreceiv^fs on the fibernetworkmay mark different sections of SONET 
SPE area as reusable when a packet is received by different receivers. 

The present invention may provide the abihty to mark a portion (or many portions) of a 
SONET SPE payload area as non-reusable. With such an implementation, when a receiver receives the 
packet, the packet area is not generally reused by another receiver/transmitter. However, the same receiver 
may reuse the markedpayload area for add/dtop applications. Allowing the same receiver to re-use apacket 
may help TDM channels and packet data within a single SPB. 

Over time, bit definitions inside a payload header may change as further research is 
conducted on the fiber data protocol operation. Such changes in bit definitions are conmion in data 
communication protocols and do not change the nature and cont^t of present invention. 

The present invention often refers specifically to SONET. However, Synchronous Digital 
Hierarchy (SDH) protocols are equally ^propriate. SDH is similar to SONET with differences in bit 
filming. These framing differences, however, do not change the discussion and scope of the present 
invention. 

While the invention has been particularly shown and described with reference to the 
preferred embodiments thereof, it will be understood by those skilled in the art that various changes in fomi 
and details may be made without departing firom the spirit and scope of the invention. 
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CLAIMS 

1. A frame configured to: 

(i) be transmitted on a network; and 

(ii) store one or more data packets in a plurality of channels, wherein a first one or more of 
said plurality of channels is configured to store one or more fragments of said one or more data packets. 

2. An apparatus comprising: 

one or more nodes coupled to a network, each node configured to receive and/or transmit one 
or more of a plurality of frames, wherein each of said plurality of frames is configured to store one or more 
data packets in a plurality of channeb, wher^ one or more of said channels is configured to store one or 
more fragments of said one or more data packets separated by an offset pointer. 

3. A method for transfening data comprising the steps of. 

(A) receivhig and/or transmitting one or more of a plurality of frames; 

(B) configuring each of said frames to store one or more data packets in a plurality of 

channels; and 

(C) configuring said channels to store one or more fragments of said one or more data 
packets, each separated and linked by an offset pointer. 

4. A frMie for transmitting information via anetwork, com^jrising one or more packets 
of different data types and lengths located anywhere inside the firame. 

5. An apparatus comprising: 

aptoality of nodes each configiured to receive and'or transmit generic packets, wherein each 
of said generic packets (a) comprises one or more packets each having (i) a payload configiured to store a 
data type of one or more data types and (ii) a header configured to store configuration information and (b) 
comprises one of a plurality of data types. 

6. An apparatus comprising: 

a network configured to transfer a plurality of frrames; and 
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one or more nodes coupled to said network each configured to receive and/or transmit one 
or more of said plurality of fiames, wherein each of said plurality of frames is configured to store one of 
a number of packets of different data types and different data lengths, anywhere within the frame. 

7. A method comprising the steps of: 

(A) receiving a packet; 

(B) det^mining a packet type indicating a type of data contained in the packet based on 
a packet identifier; and 

(C) processing the packet based on said packet type. 

8. Ametiiod for processing a firame of apluxality of packet types, comprising the steps 

of: 

(A) identifying a length of said frame; 

(B) reading a headar of said firame; and 

(C) identifying a reusability of a packet of said one or more packet types in response to 

said header. 



of: 



9. A method for transmitting a firame of a plurality of packet types, comprising the steps 

(A) retrieving said firame; 

(B) retrieving a packet type of said plurality of packet types; and 

(C) storing said packet type in said firame. 

10. A packet configured to transmit information via a network, con^rising aheader error 
portion and a payload error portion. 

1 1. An apparatus comprising: 

one or morenodes coupled to anetwork, eachnodeconfiguredtoreceiveand/ortransmitone 
or more of a plurality of packets, each comprising a first portion configured to store payLoad error 
information and a second portion configured to store header error information. 
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12. A me&od for transmitting a plurality of packets between one or more nodes 
comprising the steps of:* 

(A) receiving said plvirality of packets at each of said one or more nodes; and 

(B) transmitting said plurality of packets at each of said one or more nodes, each packet 
comprising a first portion configured to store payload error information and a second portion configured 
to store header error information. 

13. A packet comprising a payload configured to transmit information via a netwoik, the . 
packet comprising one or more Idbels configured to control routing of the packet and said payload. 

14. An apparatus comprismg: 

one or more nodes configured to transfer one or more packets, each padcet comprising a 
payload and one or more labels configured to control switching of the one or more packets and said payload, 
wherein each node is configured to transmit and/or receive said one or more packets in response to said one 
or more labels. 

15. A method for transmitting one or more packets of data comprising the steps of: 

(A) transmitting and/or receiving a frame comprising one or more packets, each comprising 
one or more labels and a payload; and 

(B) controlling switching of said one or more packets of said fi^me in response to one or 

more labels. 
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